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SUMMARY 


Voughti  Corporation  has  developed,  under  contract  with  the  Naval  Air 
Systems  Command,  reliability  prediction  models  for  predicting  baseline 
reliability  characteristics  of  notional  (conceptual)  Navy  aircraft  based  only 
on  values  of  aircraft  design/performance  parameters.  The  models  were 
developed  based  on  the  need  for  prediction  models  responsive  to  notional 
aircraft  design/performance  parameter  values. 

The  Baseline  Reliability  Prediction  Models  consist  of  two  models,  one  for 
fixed  wing  aircraft  and  another  for  rotary  wing  aircraft.  The  models  consist 
of  equations  which  relate  two-digit  Work  Unit  Code  (WUC)  subsystem  Mean  Flight 
Hours  Between  Failures  (MFHBF)  to  aircraft  design/performance  parameters.  The 
model  for  fixed  wing  aircraft  consists  of  40  prediction  equations  while  the 
model  for  rotary  wing  aircraft  consists  of  35  prediction  equations. 

Development  of  the  Baseline  Reliability  Prediction  Models  was  accomplished 
by  a  three-phase  study:  (1)  Data  base  development,  (2)  model  derivation,  and 
(3)  model  validation.  The  data  bases  consist  of  a  compilation  of  MFHBF  data 
at  the  two-digit  WUC  subsystem  level  obtained  from  the  Navy  Maintenance  and 
Material  Management  (3M)  System  and  aircraft  design/performance  parameters  for 
each  of  32  fixed  wing  and  11  rotary  wing  historical  Navy  aircraft.  Baseline 
MFHBF  prediction  equations  were  derived  through  use  of  statistical  methods  to 
select  predictor  aircraft  design/performance  parameters  and  to  mathematically 
relate  two-digit  WUC  subsystem  MFHBF  to  selected  aircraft/design  parameters. 


PREFACE 


This  final  Technical,  Report  on  Development  of  Baseline  Reliability 
Prediction  Models  study  was  prepared  by  the  Reliability  Engineering  Group  of 
the  Vought  Corporation,  Dallas,  Texas  under  Contract  No.  N00019-79-C-0355  for 
the  Naval  Air  Systems  Command,  Washington,  D.  C.  The  objective  of  the  study 
was  to  develop  mathematical  models  which  would  permit  prediction/evaluation  of 
the  reliability  characteristics  of  notional  Navy  aircraft  based  only  on  the 
aircraft  design/performance  parameters. 

The  c  ntract  was  issued  on  27  April  1979  by  Naval  Air  Systems  Command 
(NAVAIR),  Washington,  D.  C.  Mr.  Steve  Meek  (PMA  2694)  was  technical  contract 
monitor.  The  contract  period  from  27  April  through  27  October  1979  covered 
development  of  the  Baseline  Reliability  Prediction  Model  for  fixed  wing 
aircraft.  An  Interim  report  covering  this  period  was  submitted  to  NAVAIR  on 
27  October  1979.  The  contract  was  modified  as  a  result  of  NAVAIR's  exercise 
of  a  proposal  option.  The  contract  period  was  extended  through  27  February 
1980  to  provide  for  development  of  the  Baseline  Reliability  Prediction  Model 
for  rotary  wing  aircraft.  The  final  report  covers  the  entire  period  of 
contract  performance  from  27  April  1979  to  27  February  1980. 

Messrs.  Steve  Meek  (PMA  2694),  John  Zell  (AIR  5185),  Dave  McGoy  (AIR 
5185),  and  Alek  Gacic  (AIR  5185)  provided  technical  consultation  and 
assistance  in  acquisition  of  required  data,  which  contributed  significantly  to 
the  successful  completion  of  this  study.  Comments  received  from  NAVAIR's 
review  of  the  interim  report  contributed  to  the  final  report.  Mr.  Mike  Waltz 
at  the  Naval  Aviation  Logistics  Center  (NALC)  provided  valuable 
suggestions/comments  from  his  review  of  the  interim  report  and  final  report 
draft. 
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1. 


INTRODUCTION 


This  volume  is  the  first  of  a  two-volume  final  report  presenting  the 
results  of  a  study  to  develop  mathematical  models  for  predicting  baseline 
reliability  characteristics  of  notional  (conceptual)  Navy  aircraft.  The  term 
"baseline”  is  defined  as  descriptive  of  reasonable  expectations  based  on 
historical  operational  trends.  The  mathematical  models  developed  provide  the 
capability  of  predicting  baseline  reliability  characteristics  of  notional 
aircraft  based  only  on  values  of  aircraft  design/performance  parameters. 

1.1  Need  For  This  Study.  The  increased  emphasis  on  reliability  by  the 
Navy  has  resulted  in  reliability  being  a  major  design  consideration.  This  in 
turn  has  resulted  in  a  need  for  increased  capability  to  evaluate  weapon  system 
reliability  characteristics  during  c.ie  conceptual  phase.  Tne  need  for  a 
mathematical  model  to  evaluate  the  reliability  characteristics  of  notional 
aircraft  is  especially  evident  when  a  large  number  of  aircraft  are  being 
studied  as  in  the  Sea  Based  Air  Master  Study  effort. 

There  is  also  a  need  for  a  mathematical  model  for  use  in  establishing 
realistic  baseline  reliability  requirements  for  planned  Navy  aircraft,  '.he 
process  of  establishing  baseline  reliability  requirements  should  reflect  fleet 
experience  of  historical  aircraft.  An  additional  need  is  a  mathematical  model 
for  use  in  evaluating  contractor  reliability  predictions  submitted  in  response 
to  a  Request  For  Proposal. 

1.2  Study  Objectives.  The  objective  of  this  study  was  to  develop 
mathematical  models  for  prediction  of  notional  Navy  aircraft  baseline 
reliability  characteristics.  To  accomplish  this  objective,  models  are 
required  which  are  responsive  to  variations  in  aircraft  design.  In  addition, 
it  is  required  that  the  models  are  based  on  variables  whose  values  are 
available  during  conceptual  design. 

Therefore,  the  specific  objective  was  to  develop  mathematical  models, 
relating  aircraft  reliability  characteristics  to  aircraft  design/performance 
parameters.  One  model  was  to  be  developed  for  fixed  wing  aircraft  and  another 
for  rotary  wing  aircraft.  The  mathematical  expressions  were  to  be  developed 


1 


by  statistical  analyses  of  the  relationships  between  reliability 
characteristics  and  aircraft  deslrn/performance  parameters  of  43  historical 
Navy  aircraft. 

1,3  organization  of  Report.  This  volume  contains  three  sections.  The 
approach  taken  In  development  of  the  data  bases  and  the  Baseline  Reliability 
Prediction  Models,  Including  model  validation  procedures,  Is  presented  In 
Section  2.  Section  3  provides  a  description  of  the  prediction  models  and 
presents  the  reliability  prediction  technique  as  well  as  model  usage.  Section 
4  presents  the  conclusions  derived  from  the  study  and  recommendations  for 
model  refinements. 


2.  APPROACH 


The  fixed  wing  and  rotary  wing  aircraft  Baseline  Reliability  Prediction 
Models  consist  of  two  sets  of  equations  which  relate  aircraft  reliability 
characteristics  at  the  two-digit  WUC  subsystem  level  to  design/performance 
parameters.  The  following  sections  cover  (1)  the  data  base  requirements  and 
development,  (2)  the  development  of  the  model,  and  (3)  the  validation  of  the 
model , 

2.1  General.  The  Baseline  Reliability  Prediction  Models  for  fixed  wing 
and  rotary  wing  aircraft  were  developed  by  applying  statistical  methods  to 
derive  mathematical  expressions  relating  the  Mean  Flight  Hours  Between 
Failures  (MFHBF)  of  two-digit  WUC  subsystems  and  aircraft  design/performance 
parameters  from  historical  Navy  aircraft.  For  each  two-digit  WUC  subsystem 
included  in  the  fixed  wing  and  rotary  wing  aircraft  models,  an  equation  was 
derived  of  the  form 

T  =  bQ  +  b,X1  +  b?X2  +  ....  +  bnXn 

?  Is  the  predicted  value  of  the  MFHBF  or  natural  log  of  the 
MFHBF,  ln(MFHBF),  of  a  two-digit  WUC  subsystem,  depending 
on  which  form  provided  the  best  fit, 

XpXg,  . .,  Xn  are  selected  aircraft  design/performance 
parameters, 

b  ,  b,,  ...  b„  are  coefficients  derived  through 
o  i  n 

statistical  methods  applied  to  the  historical  aircraft 
values  for  the  MFHBF  of  the  two-digit  WUC  subsystem  and  the 
design/performance  parameters. 

Figure  2-1  provides  an  overview  of  the  model  development  process  as  well 
as  model  usage.  Development  of  the  Baseline  Reliability  Prediction  Models 
required  compilation  of  aircraft  design/performance  parameters  and  reliability 
characteristics  of  representative  historical  Navy  aircraft,  selection  of 
design/performance  parameters,  derivation  of  baseline  reliability  prediction 
equations,  and  model  validation.  The  models  can  then  he  used  to  predict  the 


Figure  2-1.  Baseline  Reliability  Prediction  Model 
Devel opmen  t/ Imp! emen tati on  Diagram 


reliability  characteristics  of  notional  Navy  aircraft  once  the  aircraft 
des  i gn/perf ormance  parameters  are  def initized. 


2.2  Data;  Base  development.  Two  types  of  data  were  required  in  the 
performance  of  the  study:  V  ( 1 )  The  reliability  data  base  was  obtained'  as  Mean 
Flight  Hours  Between  Failure  (MFHBF)  values  at . the  two-digit  Work  Unit  Code 


(WUC)  level  for  historical  Navy  aircraft  from  the  Navy's  fleetwide  data 
system;  and  (2)  the  design/performance  parameters,  which,  should  be  available 


early  in  aircraft,  development,  were  compiled  from  several  sources  discussed  in 
Section ;i  2,2; 2.  These  data  bases  were  used  to  develop  two  reliability 


prediction  models,  one  for  fixed  wing-aircraft  and  the  other  for  rotary  wing 


aircraft. 


MFHBF  data  and  design/performance  parameters  were  obtained  on  each  of  43. 
historical  Navy  aircraft.  Of  these  aircraft  shown  in  Table  2-1,  thirty-two 
are  fixed  wing  and  eleven  are  rotary  Wing. ,.  The  selected  aircraft  were 
considered  the  most  representati ve  available  for  use  in  deriving  the  two 
prediction  models  which  would1  ultimately  be  used  to  predict  the  reliability  of 
notional  aircraft  including  those  in  the  Saa  Based  Air  Master  Study  (SBAMS)<; 


2.2.1  Reliability  Data  Base.  The  Fleet  Weapon  System  Reliability  and 
Maintainability  Statistical  Summary  Tabulation  Report,  MSO  4790.A2142.0l  is 
based  on  the  Navy's  Maintenance  and  Material  Management  (3M)  system.  This 
report  presents,  reliability  and  maintainability  summaries  by  Work  Unit  Code 
(WUC)  for  all  Navy  aircraft. 

Reliability  data  was  compiled  over  the  time  period  of  July  1976  through 
dune  1979  (twelve  quarters  of  data).  The  MSO  Reports  prior  to  July  1976  are 
semi-annual,  instead  of  quarterly.  In  order  to  keep  the  data  reporting 
periods  of  equal  duration,  only  MSO  Reports  from  July  1976  forward  have  been 
used  in  this  study.  The  last  report  that  could  be  included  was  the  quarter 
ending  with  June  1979. 


Reliability  data  was  collected  at  the  two-digit  WUC  subsystem  level  and  at 
the  aircraft  level  for  fixed  wing  and  rotary  wing  aircraft.  For  each  of  the 
twelve  quarters,  the  fleet-wide  totals  for  the  number  of  failures  and  the 
corresponding  aircraft  flight  hours  were  obtained  for  each  aircraft.  The 
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TABLE  2-1. 

NAVY  AIRCRAFT  USED  IN  THE  DEVELOPMENT  OF  THE 
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PREDICTION  MODELS 
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i 

FIXED  WING  AIRCRAFT  (32) 

r'i 

- 

£3  3 
3-1 

p  - 

jp! 

0 

Fighter 

0 

Airborne  Early  Warning 

y '  5 

i.i  ..j 

1  3 

\  ‘4 

F-4J,  N 

E- IB 

J  -j 

F-14A 

E-2B,  C 

- 1 

it.- 
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0 

Attack 

0 

Anti-Submarine  Warfare 
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•  4 

A-4E,  F,  M 

S-3A 

•I 

_  i  -3 

1} 

A-6A,  E 

0 

Patrol  Anti-Submarine  Warfare 
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P  ■ 

A-7A,  B,  C,  E 

P-3A,  B,  C 
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0 

Carrier  on  Board  Delivery  Transport 
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0 
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ROTARY  WING  AIRCRAFT  (11) 
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twelve  quarters  of  data  were  split  into  two  groups.  The  first  eight  quarters 
from  July  1976  through  June  1978  became  the  Reliability  Data  Base  and  were 
used  for  model  development.  The  four  quarters  from  July  1978  through  June 
1979  were  used  to  verify  the  stability  of  the  first  eight  quarters.  The  MFHBF 
was  calculated  for  each  of  the  twelve  quarters  and  for  both  the  eight  and  four 
quarter  time  periods  using  the  formula: 

MFHBF  =  total  flight  hours 

total  number  of  failures 

The  WUC  subsystems  were  not  standardized  for  either  the  fixed  or  rotary 
wing  aircraft.  The  effort  to  standardize  the  WUC  subsystems  for  five  fixed  , 
wing  aircraft  proved  to  be  a  larger  undertaking  in  manpower  and  time  than 

originally  anticipated.  This  led  to  an  agreement  with  NAVAIR  to  consider  the 
standardization  of  the  WUC  subsystems  to  be  beyond  the  scope  of  the  funded 
effort. 

The  MFHBF  data  was  analyzed  for  consistent  trends,  variability,  and 

stability.  These  analyses  were  performed  among  different  aircraft  for  a  given 
two-digit  WUC,  as  well  as  between  different  two-digit  WUC  subsystems  of  a 
given  aircraft,  for  both  fixed  and  rotary  wing  aircraft.  When  the  MFHBF 
values  were  plotted  against  the  twelve  data  quarters  for  both  cases,  a  wide 
variety  of  patterns  resulted.  While  some  individual  patterns  showed  definite 
trends,  there  was  no  consistent  trend  over  all  aircraft  for  e.  given  WUC 

subsystem,  or  over  all  WUC  subsystems  for  a  given  aircraft.  The  largest 

variability  was  shown  by  those  WUC  subsystems  which  had  only  a  few  failures 
reported  per  quarter  for  a  given  aircraft  with  approximately  the  same  number 
of  flight  hours  for  each  quarter.  For  these  WUC  subsystems  a  small  change  in 
the  reported  number  of  failures  for  a  quarter  could  have  made  a  significant 
change  in  the  quarterly  MFHBF  values.  Since  the  MFHBF  values  in  the  data  base 
resulted  from  averaging  over  an  eight  quarter  period,  the  monthly  variability 
did  not  have  a  significant  effect  in  most  cases.  However,  a  number  of  cases 
exist  where  the  calculated  MFHBF  values  represented  extreme  values  or 
outliers.  The  term  "outlier"  was  applied  to  those  MFHBF  values  which  were 
found  to  lie  outside  the  general  pattern  formed  by  the  other  MFHBF  values  for 
<  given  WUC  when  plotted  against  individual  design/performance  parameters. 
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Many  of  these  outliers  corresponded  to  MFHBF  values  which  were  computed  with 
only  one  or  two  quarters  of  data  reported  out  of  eight  quarters.  This  was 
considered  to  be  Insufficient  data  to  compute  a  representative  long  term  MFHBF 
value.  A  total  of  17  MFHBF  values  for  the  fixed  wing  and  12  values  for  rotary 
wing  a1rr**aft  were  deleted  for  this  reason. 

The  long  term  stability  of  the  MFHBF  data  was  examined  by  comparing  the 
MFHSF  of  the  candidate  data  base  (the  first  eight  quarters  of  the  twelve 
quarter  period)  with  the  MFHBF  of  the  verification  data  (the  last  four 
quarters).  In  some  cases  the  MFHBF  of  the  verification  data  was  higher  than 
the  candidate  data  base  and  lower  In  other  cases.  Again,  the  data  showed  no 
consistent  trends,  and  the  difference  In  the  MFHBF  between  the  two  time 
periods  was  not  considered  significant  for  any  cases.  It  was  concluded  that 
no  significant  trends  or  unusual  variability  existed  at  the  two-digit  WUC 
level  over  all  WUC  subsystems  or  aircraft,  and  that  the  MFHBF  calculated  over 
the  eight  quarters  from  July  1976  through  June  1978  were  sufficiently  stable 
to  be  used  as  the  historical  Reliability  Data  Base  for  the  fixed  and  rotary 
wing  aircraft. 

2.2.2  Aircraft  Design/Performance  Parameters  Data  Base.  The  data  base 
consisted  of  1C1  design/performance  parameters  for  each  of  the  32  fixed  wing 
aircraft  and  89  parameters  for  each  of  the  11  rotary  wing  aircraft.  These 
parameters  served  as  the  predictor  variables  for  the  regression  analysis  used 
in  developing  the  reliability  prediction  equations  for  the  two  models.  The 
parameters  were  compiled  from  the  following  sources: 

o  Standard  Aircraft  Charcteristics  (SAC)  Charts  (MI L-C-501 1 A) 
o  Group  Weights  Statements  (MIl-STD-1374) 
o  Aircraft  and  Engine  Companies 

o  Jane's  All  the  World's  Aircraft 

o  NATOPS  Flight  Manuals 

o  Aviation  Week  and  Space  Technology,  Specifications 

The  Standard  Aircraft  Characteristics  (SAC)  Charts  and  tne  Group  Weight 
Statements  were  used  as  the  primary  data  sources.  The  remaining  sources  were 
used  to  obtain  information  not  available  from  these  two  primary  sources.  The 
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engine  companies,  in  particular,  provided  information  on  several  engine 
parameters. 

The  aircraft  parameters  included  in  the  Design/Performance  Data  Base  were 
divided  into  four  groups  as  follows: 

o  Physical  characteristics  including  dimensions,  volumes,  and  weights. 

o  Performance  parameters  including  speed,  range,  altitude,  and  rate  of 

climb. 

o  Engine  characteristics  including  thrust,  size,  weight,  and  fuel 
consumption. 

o  Categorical/derived  parameters  including  squared 

characteristic  values,  and  ratios  of  physical  characteristics. 

Examples  of  these  groups  are  presented  in  Tables  2-2  and  2-3  for  fixed  and 
rotary  wing  aircraft,  respectively.  These  parameters  were  representative  of 
the  candidate  variables  for  the  thirty-two  fixed  wing  and  eleven  rotary  wing 
aircraft. 

2.3  Prediction  Model  Development.  The  Baseline  Reliability  Prediction 
Models  were  developed  to  predict  the  MFHBF  of  notional  fixed  wing  and  rotary 
wing  aircraft.  Each  model  consisted  of  a  set  of  mathematical  equations  used 
to  predict  the  baseline  MFHBF  of  notional  aircraft  at  the  two-digit  WUC 
subsystem  levels.  The  set  of  predicted  MFHBF  values  obtained  from  the 
equations  would  then  be  combined  mathematically  to  obtain  a  predicted  value 
for  the  overall  reliability  of  the  notional  aircraft. 

During  the  model  development  phase,  three  tasks  were  undertaken.  First, 
aircraft  design/performance  parameters  were  selected  for  each  two-digit  WUC 
prediction  equation.  Next,  using  the  parameter  values  and  the  MFHBF  of 
historical  Navy  aircraft  for  each  two-digit  WUC  subsystem,  various  analyses 
were  performed  to  derive  the  best  form  of  an  equation  for  predicting  the  MFHBF 
of  each  two-digit  WUC  suosystem.  Finally,  using  the  aircraft 
des i gn/performance  parameters  which  formed  the  best  relationship  to  the 
historical  MFHBF,  the  coefficients  for  the  equation  were  estimated. 

2.3.1  Selection  of  Aircraft  Design/Performance  Parameters.  Selection  of 
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TABLE  2-2.  EXAMPLES  OF  PARAMETERS 
FOR  FIXED  WING  AIRCRAFT 


PHYSICAL  CHARACTERISTICS 


Crew  Size 

No.  of  Moveable  Flight  Control  Surfaces 
Wing  Sweep  at  1/4  Chord 
Max.  Aircraft  Length 
Wing  Area 

Avionics  Weight  Installed 
Empty  Weight 

Max.  Take-Off  Weight  —  Catapult 

PERFORMANCE  PARAMETERS 

Max.  Wing  Loading 

Max.  Rate  of  Climb  at  Sea  Level 

Max.  Service  Celling 

Max.  Combat  Radius 

Max.  Speed  — Mach  No. 

ENGINE  CHARACTERISTICS 

Max.  Thrust  per  Engine 
Total  Aircraft  Thrust  --  Military 
Engine  Weight  Installed  per  Engine 
Turbine  Inlet  Temperature 
Specific  Fuel  Consumption 
Max.  Compression  Ratio 

CATEGORICAL/DERIVED  PARAMETERS 

Flight  Design  Weight  to  Max.  Take-Off  Weight 
Military  Thrust  to  Design  Weight 
Max.  Thrust  to  Max.  Take-Off  Weight 


TABLE  2-3.  EXAMPLES  Or  PARAMETERS 
FOR  ROTARY  WING  AIRCRAFT 


PHYSICAL  CHARACTERISTICS 

o  No.  of  Main  Rotor  Blades 
o  Mein  Rotor  Radius 

o  Empty  Weight 

o  Total  Fuel  Capacity 

o  Main  Rotor  Blade  Area  (Total) 

o  Max.  Disc  Loading 

o  Rotor  Weight 

o  Blade  Loading 

PERFORMANCE  PARAMETERS 

o  Vertical  Rate  of  Climb  at  Sea  Level  —  Military  Power 
o  Max.  Speed  at  Sea  Level 

o  Max.  Combat  Radius 

ENGINE  CHARACTERISTICS 

o  Military  or  Intermediate  SHP  per  Engine 
o  Turbine  Inlet  Temperature 

o  Total  Aircraft  SHP  —  Military  or  Intermediate 

o  Main  Rotor  Transmission  Limits  --  SHP 

CATEGORICAL/DERIVED  PARAMETERS 

Military  SHP  per  Engine  to  Engine  Weight  Installed  per  Engine 
Total  Aircraft  SHP  --  Military  or  Intermediate  Power  to  Max. 
Take-Off  Weight 


o 

o 


the  aircraft  parameters  from  the  Design/Performance  Data  Bases  for  development 
of  prediction  equations  was  based  on  the  following:  (1)  The  parameters  had  to 
be  appllcaole  to  notional  aircraft  and  their  values  available  during  the 
conceptual  design  phase,  (2)  the  parameters  were  to  have  Intuitive  appeal, 
from  an  engineering  viewpoint,  whenever  possible  ,  and  (3)  historically,  the 
parameters  had  to  be  good  predictors  of  the  MFHBF  of  a  given  two-digit  WUC 
subsystem. 

Certain  aircraft  parameters  were  either  omitted  from  consideration  or 
their  definitions  modified  due  to  differences  between  existing  and  notional 
aircraft.  Only  those  parameters  which  were  meaningful  for  notioncl  aircraft 
were  used  in  the  prediction  equations.  For  example,  the  Minimum  Stall  Speed 
for  fixed  wing  aircraft  was  not  included  In  the  fixed  wing  aircraft  prediction 
equations,  since  the  parameter  has  different  significance  for  Vertical/Short 
Takeoff  or  Landing  (V/STOL)  aircraft.  Some  parameters  were  defined 
differently  for  notional  designs  to  allow  the  notional  aircraft  to  better 
conform  to  existing  aircraft  features.  For  example,  the  NunC  of  Engines  is 
defined  to  be  the  number  of  primary  engines  for  aircraft  esigns  having 
primary  li^t/cruise  engines  and  auxiliary  lift  engines. 

As  the  prediction  models  were  developed  for  use  during  conceptual  design, 
the  availability  of  certain  notional  parametric  values  required  careful 
consideration.  Only  those  design  and  performance  parameters,  normally 
available  at  this  stage  in  the  design  process,  were  included  in  the 
equations.  This  resulted  in  the  exclusion  of  parameters  associated  with 
detailed  design. 

Engineering  judgment  was  used  in  the  development  of  the  set  of  parameters 
for  each  two-digit  WUC  from  which  the  specific  aircraft  parameters  for  each 
equation  would  be  chosen.  With  the  assistance  of  design  and  systems 
engineers,  the  parameters  were  assigned  one  of  four  levels  of  priority  for 
each  two-digit  WUC  subsystem.  The  level  of  priority  assigned  reflected  the 
degree  of  association  the  aircraft  parameter  was  felt  to  have  with  the 
reliability  of  the  two-digit  WUC  subsystem.  There  were  two  principal  reasons 
for  using  engineering  expertise  in  the  selection  process.  First,  this 
approach  was  the  fastest  means  of  eliminating  parameters  which  should  have  no 
connection  with  a  given  two-digit  WUC  subsystems.  Secondly,  the  use  of 


design/performance  parameters  with  intuitive  appeal  In  the  prediction 
equations  was  considered  desirable. 

The  selected  parameters  were  then  examined  for  their  predictive  ability 
using  correlation  analysis.  Through  correlation  analysis,  the  degree  of 
linear  association,  or  correlation,  between  the  MFHBF  and  the 
design/performance  parameters  of  interest  for  each  two-digit  WUC  was 
determined.  If  the  degree  of  linear  association  was  strong,  as  indicated  by 
the  correlation  coefficient  having  a  value  close  to  +1.0  or  -1.0,  the 
parameter  was  felt  to  be  a  potentially  good  predictor  of  the  MFHBF  for  the 
two-digit  WUC  subsystem.  For  example,  the  correlation  between  che  MFHBF  for 
WUC  14000  (Flight  Controls)  and  the  Flight  Control  Surface  Area  for  historical 
fixed  wing  aircraft  was  found  to  be  0.708.  This  degree  of  linear  association 
between  the  MFHBF  and  the  Flight  Control  Surface  Area  is  reflected  graphically 
in  Figure  2-2.  The  strong  linear  trend  found  in  the  data  implied  that  the 
Flight  Control  Surface  Area  had  historically  been  a  good  indicator  of  the 
MFHBF  for  the  Flight  Controls.  Thus,  the  Flight  Control  Surface  Area  was 
accepted  as  a  potentially  good  predictor  for  the  reliability  of  WUC  11000. 

In  addition  to  measuring  the  linear  association  between  the  MFHBF  and  an 
aircraft  design/performance  parameter,  correlation  analysis  was  also  used  to 
measure  the  linear  association  between  the  aircraft  parameters  themselves.  If 
the  correlation  coefficient  for  two  aircraft  parameters  was  close  to  +1.0  or 
-1.0,  the  narameters  were  considered  "statistically  equivalent".  This  meant 
that,  mathematically,  they  would  make  approximately  the  same  contribution  to 
the  predictive  ability  to  an  equation.  The  strong  linear  associations  between 
aircraft  parameters  were  important  to  the  development  of  the  prediction 
equations.  These  relationships  often  permitted  the  substitution  of  one 
parameter  for  another  without  affecting  the  predictive  quality  ot  the 
equation.  The  strong  correlation  sometimes  led  to  only  one  of  the  parameters 
being  used  in  a  prediction  equation.  As  both  parameters  had  the  same 
predictive  effect  for  a  given  equation,  the  use  of  both  parameter,'  was 
mathematically  redundant.  For  example,  the  Folded  Wing  Span  and  Flight 
Control  Surface  Area  had  a  correlation  coefficient  of  0.926.  Since  the  use  of 
both  parameters  was  redundant,  only  the  Flight  Control  Surface  Area  was 
included  in  the  fixed  wing  aircraft  prediction  equation  for  WUC  14000. 
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2-2.  MFHBF  for  Flight  Controls  vs.  Flight  Control 
Surface  Area  for  Fixed  Wing  Aircraft 
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Another  technique  used  to  examine  the  predictive  ability  of  the  aircraft 
parameters  was  a  forward  selection  procedure  called  stepwise  regression.  In 
stepwise  regression,  parameters  were  selected,  one  at  a  time,  from  the  set  of 
parameters  felt  to  have  Intuitive  appeal,  to  form  an  equation  for  each 
two-digit  WUC  subsystem.  The  criteria  for  selection  required  the  parameter 
having  the  strongest  linear  association  with  the  MFHBF  to  be  chosen  first.  In 
the  succeeding  steps,  the  parameters  which  made  the  greatest  additional 
contribution  to  the  statistical  quality  of  the  equation  were  added. 

The  stepwise  regression  procedure  helped  to  reduce  the  set  of  parameters 
which  would  receive  further  consideration.  As  the  number  of  parameters  which 
could  be  used  to  form  each  prediction  equation  was  mathematically  limited  by 
the  numher  of  historical  aircraft  used  to  develop  the  equation,  some 
parameter*  had  to  be  eliminated.  Those  parameters  not  chosen  in  the  stepwise 
procedure  were  seen  as  having  little  predictive  ability,  and,  therefore, 
omitted  from  further  analysis. 

2.3.2  Prediction  Equation  Derivation.  The  statistical  technique  used  to 
derive  the  prediction  equations  for  the  Baseline  Reliability  Prediction  Models 
was  multiple  linear  regression  analysis,  or  simply  regression  analysis.  Using 
the  regression  technique,  the  MFHBF  for  historical  aircraft  were 
mathematically  combined  with  the  corresponding  values  for  the  parameters  of 
interest  to  obtain  values  for  the  coefficients  of  the  parameters  in  each 
equation. 

The  functio.,*  ~ms  considered  for  prediction  equations  involved  using  a 
mathematical  functio..  of  \-he  MFHBF,  as  well  as  the  MFHBF  itself.  The 
"l-shaped"  trend  found  in  the  graphs  of  the  characteristics  versus  the  MFHBF 
for  historical  aircraft  indicated  the  need  for  a  transformed  functional  form 
for  the  prediction  equation  of  most  of  the  two-digit  WUC  subsystems.  Since 
the  "L-shaped"  trend,  as  seen  for  example  in  Figure  2-3,  was  found  using 
different  parameters  with  the  same  MFHBF  data,  a  transformation  was  considered 
for  the  MFHBF. 


MFHBF 


The  natural  log  of  the  MFHBF  was  found  to  be  the  best  functional  form  of 
the  MFHBF  for  most  of  the  prediction  equations.  A  comparison  of  Figures  2-3 
and  2-4,  Involving  the  MFHBF  of  WUC  14000  (Flight  Controls)  and  the  Wing 
Sweep,  l.e.,  the  sweepback  angle  of  the  wing,  for  historical  fixed  wing 
aircraft,  reflects  the  type  of  Improved  linear  association  obtained  with  the 
natural  log  of  the  MFHBF.  The  use  of  the  natural  log  of  the  MFHBF,  Instead  of 
the  MFHBF,  improved  the  statistical  quality  and  the  predictive  ability  of  most 
of  the  prediction  equations. 

While  selected  ratios  of  parameters,  such  as  the  Maximum  Thrust  to  Maximum 
Take-Off  Weight  and  Military  Thrust  to  Flight  Design  Weight,  and  cross 
products,  such  as  the  Maximum  Landing  Weight  times  the  square  of  the  Landing 
Sink  Speed,  were  used  as  parameters,  other  functions  of  the  parameters  were 
not  considered  for  the  equations.  By  using  the  natural  log  of  the  MFHBF,  most 
of  the  trends  indicative  of  the  need  for  a  different  functional  form  for  the 
charcteristics  were  eliminated.  As  a  sufficient  number  of  meaningful 
parameters  was  found  to  have  good  predictive  ability  for  developing  each 
equation,  no  further  study  of  other  functional  forms  was  made. 

Additional  steps,  related  to  the  choice  of  design/performance  parameters 
for  the  equations,  were  taken  to  improve  various  prediction  equations. 
Certain  equations  derived  through  regression  analysis,  such  as  those  for  some 
avionics  and  engine  related  WUC's,  were  lacking  the  statistical  quality  and 
engineering  appeal  desired.  Parameters  not  previously  considered  were  added 
to  the  Design/Performance  Data  Base.  These  parameters  were  then  incorporated 
into  certain  equations  and  analyzed  for  their  predictive  ability.  In  other 
equations,  a  "statistically  equivalent"  parameter,  previously  identified 
through  the  correlation  analysis,  was  substituted  for  another  parameter  which 
had  less  intuitive  appeal. 

While  the  stepwise  regression  procedure  had  helped  to  eliminate  those 
parameters  with  little  predictive  ability,  further  reduction  in  the  number  of 
parameters  used  in  each  equation  was  required.  When  too  many  parameters  are 
used  in  a  prediction  equation,  relative  to  the  number  of  aircraft  used  to 
develop  the  equation,  the  equation  is  said  to  "overfit"  the  data.  This  causes 
the  equation  to  do  well  in  predicting  the  historical  MFHBF  of  the  aircraft 
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Figure  2-4.  Natural  Log  of  the  MFHBF  ( 1 n(MFHBF) ) 
for  WUC  14000  vs  the  Wing  Sweep  for  Fixed  Wing  Aircraft 


used  to  derive  the  equation,  but  to  do  poorly  in  predicting  the  MFHBF  for 
other  aircraft.  To  reduce  the  number  of  aircraft  parameters  in  each  equation, 
statistical  measures  were  used  to  determine  which  parameters  contributed  the 
least  to  the  statistical  quality  of  the  equation.  With  these  parameters 
eliminated  from  further  consideration,  other  measures  determined  which  subset 
of  the  remaining  parameters  formed  the  best  equation,  statistically. 

Even  with  the  reduction  in  the  number  of  parameters,  the  equations  were 
felt  to  be  responsive  to  different  notional  aircraft  configurations.  Because 
of  the  large  number  of  historical  aircraft  used  in  development  of  the  models, 
the  average  fixed  wing  aircraft  prediction  equation  still  included  nine 
aircraft  parameters  and  the  average  rotary  wing  aircraft  prediction  equation 
included  five  aircraft  parameters.  With  this  number  of  parameters,  many  of 
the  principal  design/performance  differences  between  aircraft  which  were 
related  to  a  given  two-digit  WUC  subsystem  were  accounted  for  in  predicting 
the  MFHBF. 

2.3.3  Estimation  of  Coefficients.  To  derive  the  final  prediction 
equations,  the  appropriate  method  of  regression  analysis  for  calculating  the 
coefficients  of  the  parameters  was  identified  for  each  equation.  Because  the 
degree  of  linear  association  between  parameters  of  the  equation  influenced  the 
values  of  the  coefficients,  two  regression  methods  were  used.  When  none  of 
the  aircraft  parameters  were  strongly  correlated,  the  least  squares  regression 
technique  was  used.  Otherwise,  the  ridge  regression  technique  was  required, 
to  preclude  the  instability  of  the  least  squares  coefficient  values. 

The  stability  of  the  coefficients  related  to  how  the  baseline  MFHBF 
predicted  value  changed  as  the  values  for  the  parameters  change.  When  slight 
changes  in  the  parameter  values  caused  radical  changes  in  the  predicted 
values,  the  coefficients  were  considered  unstable.  Since  the  notional  values 
for  certain  aircraft  parameters  were  expected  to  differ  from  the  historical 
values,  stable  coefficients  were  required  if  the  equations  were  to  have  good 
predictive  ability. 

2.4  Model  Validation.  During  model  validation,  the  adequacy  of  the 
functional  form  of  the  equations,  the  sensitivity  of  the  equations  to  the 
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historical  data,  and  the  predictive  ability  of  the  equations  with  historical 
and  notional  aircraft  characteristic  values  were  studied.  As  these  aspects  of 
the  equations  could  not  be  fully  measured  with  the  information  provided 
through  correlation  and  regression  analysis,  a  validation  procedure  was 
required  prior  to  finalizing  the  Baseline  Reliability  Prediction  Models. 

The  statistical  adequacy  of  the  form  of  the  equations  was  examined  by 
determining  whether  certain  theoretical  assumptions  about  the  data  were 
satisfied.  If  the  assumptions  were  not  satisfied  for  a  given  equation,  too 
many  parameters  had  been  removed  and/or  a  different  functional  form  of  the 
MFHBF  should  have  been  used  in  the  equation.  As  the  assumptions  appeared  to 
be  satisfied  for  those  equations  studied,  the  form  of  the  equations  was 
considered  adequate  for  prediction. 

The  sensitivity  of  the  equations  to  the  historical  data  was  measured  by 
deleting  the  historical  aircraft  one  at  a  time,  from  the  data,  and  deriving 
the  coefficients  using  the  remaining  aircraft.  If  the  size  or  sign  of  the 
coefficients  drastically  changed,  the  equation  was  considered  to  be  sensitive 
to  the  number  of  specific  aircraft  used  to  derive  the  equation.  With  such 
sensitivity,  it  is  difficult  to  determine  if  the  equation  is  correctly 
reflecting  the  relationship  between  the  MFHBF  of  the  two-digit  WUC  subsystem 
and  the  aircraft  parameters.  While  none  of  the  equations  studied  were 
considered  to  be  sensitive,  those  prediction  equations  derived  using  a  smaller 
number  of  aircraft  reflected  the  greatest  change  in  the  coefficients. 

Two  forms  of  comparison  were  made  in  examining  the  predictive  ability  of 
the  models  for  historical  aircraft.  For  a  given  prediction  equation,  the 
predicted  MFHBF  values  for  the  two-digit  WUC  subsystem  were  compared  with  the 
historical  MFHBF  values  of  each  aircraft  used  to  derive  the  equation.  A  graph 
of  the  predicted  values  versus  the  historical  values,  like  the  one  shown  in 
Figure  2-5  for  WUC  13000  (Landing  Gear)  for  fixed  wing  aircraft,  was  used  to 
determine  an  equation's  predictive  ability  for  historical  aircraft.  For  those 
equations  examined,  their  predictive  ability  appeared  reasonable. 

A  comparison  was  also  made  between  the  predicted  MFHBF  obtained  from  the 
equations  and  the  historical  MFH8F,  for  all  applicable  two-digit  WUC's  of  a 
given  aircraft.  The  predicted  MFHBF  for  the  two-digit  WUC  subsystems  were 
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then  combined  to  derive  the  predicted  MFHBF  for  the  aircraft,  and  this  value 
was  compared  to  the  historical  MFHBF  for  the  aircraft.  Unless  the  model 
predicts  well  for  historical  aircraft,  the  model  Is  not  likely  to  predict  well 
fp'  notional  aircraft. 

Results,  similar  to  those  presented  In  Table  2-4  for  the  A-7E,  were  found 
for  all  historical  aircraft.  As  predicted  values  for  only  the  two-digit  WUC's 
applicable  to  the  A-7E  were  derived,  the  list  of  two-digit  WUC's  In  Table  2-4 
does  not  Include  all  two-digit  WUC  subsystems  for  which  prediction  equations 
were  developed.  For  most  two-digit  WUC's,  the  predicted  values  were  In 
reasonable  agreement  with  the  historical  vaiues.  More  Important!'*  the 
predicted  MFHBF  value  obtained  by  combining  the  two-digit  WUC  subsystem 
predicted  values  was  close  to  the  historical  value. 

To  determine  the  models'  predictive  ability  for  notional  aircraft,  the 
baseline  MFHBF  prediction  equations  were  provided  to  NAVAIR.  NAVAIR  used  the 
prediction  equations  to  predict  the  baseline  MFHBF  of  40  notional  fixed  wing 
aircraft  designs  and  four  notional  rotary  wing  aircraft  designs  o^  the  Sea 
Based  Air  Master  Study  (SBAMS)  Aircraft  Alternatives  Definition  Task.  These 
baseline  MFHBF  values  for  each  two-digit  WUC  subsystem  were  compared  against 
the  fleet  3M  MFHBF  values  initially  used  as  a  NAVAIR  Baseline  for  the  SBAMS 
aircraft  estimates.  Except  for  aircraft  parameters  whose  values  required 
extrapolation,  both  the  rixed  wing  aircraft  predictions  and  the  rotary  wing 
aircraft  predictions  were  in  reasonable  agreement  with  the  previously  used 
baseline  estimates. 

Extrapolation,  i.e.,  the  prediction  of  baseline  MFHFF  with  notional  values 
for  aircraft  parameters  which  are  outside  the  range  of  historical  values, 
required  that  adjustment  be  made  In  certain  prediction  equations.  These 
equations  involved  aircraft  parameters  such  as  the  Max.  Rate  of  Climb  at  Sea 
Level,  Total  Aircraft  Thrust,  and  Max.  Thrust  to  Max.  Take-Off  Weight.  The 
value  predicted  for  the  baseline  MFHBF  was  unreasonable  when  the  parametric 
value  for  the  notional  aircraft  deviated  greatly  from  historical  values.  To 
overcome  the  problem,  the  parameters  requiring  extrapolation  were  either 
replaced  with  a  statistically  equivalent  parameter,  or  combined  with  different 
design/performance  parameters  to  form  an  equation  with  reasonable  predictive 
ability  for  notional  aircraft. 
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TABLE  2-4.  PREDICTION  OF  THE  KFHBF 
FOR  THE  A-7E 


PREDICTED 

HISTORICAL 

NO. 

wuc 

MFH3F 

MFHBF 

1 

nooo 

10.054 

12.090 

2 

12000 

39.365 

35.920 

3 

13000 

12.955 

10.900 

4 

14000 

20.422 

24.570 

5 

27000 

37.840 

35.910 

6 

29000 

50.645 

42.090 

7 

41000 

65.569 

50.790 

8 

42000 

16.275 

24.380 

9 

44000 

20.193 

21.170 

10 

45000 

34.616 

33.640 

11 

46000 

32.622 

42.790 

12 

47000 

80.797 

116.570 

13 

49000 

106.567 

145.630 

14 

51000 

18.948 

15.220 

15 

56000 

67.069 

363.870 

16 

57000 

52.956 

22.760 

17 

63000 

38.278 

19.320 

18 

64000 

154.050 

564.570 

19 

65000 

89.667 

83.490 

20 

66000 

1533.576 

3033.700 

21 

67000 

97.200 

381.510 

22 

71000 

61.538 

25.960 

23 

72000 

26.658 

46.610 

24 

73000 

16.305 

6.230 

25 

74000 

46.743 

53.080 

26 

75000 

35.848 

23.600 

27 

76000 

60.636 

50.220 

28 

91000 

255.093 

235.100 

29 

96000 

3017.173 

4127.820 

30 

97000 

2969.561 

2962.320 

3.  RESULTS 


The  Baseline  Reliability  Prediction  Models  have  been  designed  to  allow 
reliability  predictions  of  notional  aircraft  MFHBF  early  in  the  aircraft's 
design  evolution.  A  description  of  the  prediction  models,  the  procedure  used 
to  predict  with  the  models,  and  considerations  in  using  the  model  are 
discussed  in  the  following  sections. 

3.1  Description  of  Prediction  Models.  The  Baseline  Reliability 
Prediction  Models  consist  of  75  statistically  derived  equations  using  aircraft 
design/performance  parameters;  40  equations  for  fixed  wing  aircraft  and  35 
equations  for  rotary  wing  aircraft.  With  the  exception  of  the  fixed  wing 
equation  and  rotary  wing  equation  denoted  by  WUC  00000,  the  equations  in  each 
model  predict  the  baseline  MFHBF  at  the  two-digit  WUC  subsystem  level.  The 
fixed  wing  equation  and  rotary  wing  equation  for  WUC  00000  represents  those 
equations  developed  to  predict  an  overall  weapon  system  baseline  MFHBF.  These 
equations  are  designed  to  be  used  as  a  check  or  validation  of  the  MFHBF 
obtained  by  combining  the  two-digit  WUC  subsystem  MFHBF  predicted  values  for 
prediction  of  the  overall  notional  aircraft. 

Tables  3-1  and  3-2  present  a  description  of  the  prediction  equations  which 
comprise  the  fixed  wing  and  rotary  wing  aircraft  prediction  models.  The 
two-digit  WUC  subsystems  for  which  prediction  equations  were  developed  along 
with  the  number  and  type  of  aircraft  parameters  used  in  each  equation  are 
presented  for  both  fixed  wing  aircraft  and  rotary  wing  aircraft.  Similar 
information  is  provided  for  the  overall  weapon  system  baseline  MFHBF 
prediction  equation  (WUC  00000).  One  additional  equation,  denoted  by  WUC 
20000,  is  presented  in  Table  3-1  for  fixed  wing  aircraft.  This  equation  which 
predicts  the  baseline  MFHBF  of  both  turbojet  and  turbofan  engines  was  created 
to  supplement  the  baseline  equations  for  WUC  23000  (Turbojet  Engines)  and  WUC 
27000  (Turbofan  Engines). 


Many  of  the  same  design/performance  parameters  were  chosen  for  more  than 
one  prediction  equation.  Other  parameters  were  not  included  in  any  final 
prediction  equation  of  the  two-digit  WUC  subsystems.  Thus,  only  61  of  the  101 
parameters  of  the  Design/Performance  Data  Base  for  fixed  wing  aircraft  were 
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TABLE  3-1.  COMPOSITION  OF  PREDICTION  EQUATIONS 
FOR  FIXED  WING  AIRCRAFT 


Number  of  Aircraft  Parameters 
Used  In  Prediction  Equation 


Physical 

Performance 

wuc 

Char. 

Parameters 

00000 

6 

0 

11000 

6 

0 

12000 

4 

2 

13000 

5 

1 

14000 

8 

0 

20000 

2 

2 

22000 

1 

1 

23000 

1 

2 

24000 

2 

1 

27000 

1 

1 

29000 

0 

2 

41000 

6 

2 

42000 

7 

1 

44000 

7 

0 

45000 

6 

2 

46000 

6 

1 

47000 

4 

1 

49000 

6 

1 

51000 

6 

2 

56000 

6 

3 

57000 

5 

2 

61000 

2 

2 

62000 

3 

1 

63000 

5 

5 

64000 

5 

2 

jOOO 

5 

4 

i^oOOO 

2 

5 

S7000 

3 

2 

^9000 

2 

2 

71000 

6 

4 

72000 

4 

2 

73000 

6 

3 

74000 

6 

3 

75000 

7 

2 

76000 

5 

2 

77000 

1 

0 

91000 

3 

6 

93000 

2 

0 

96000 

4 

2 

97000 

4 

2 

Categorical/ 


Engine  Derived 

Char.  Parameters  Total 


0  1  7 

0  3  7 

0  3  9 

0  3  9 

1  1  10 

4  1  9 

1  1  4 

3  1  7 

0  1  4 

1  1  4 

5  2  9 

1  0  9 

1  0  9 

1  1  9 

2  0  10 

3  0  10 

0  2  7 

1  2  10 

1  1  10 

0  1  10 

1  1  9 

0  3  7 

0  0  4 

0  1  11 

0  1  8 

0  1  10 

0  2  9 

0  2  7 

0  1  5 

0  1  11 

0  3  9 

0  1  10 

0  0  9 

0  0  9 

0  1  8 

0  0  1 

0  0  9 

0  1  3 

0  1  7 

1  1  8 
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TABLE  3-2.  COMPOSITION  OF  PREDICTION  EQUATIONS 
FOR  ROTARY  WING  AIRCRAFT 


Number  of  Aircraft  Parameters 
Used  in  Prediction  Equation 


wuc 


Physical  Performance 

Char.  Parameters 


Categorical/ 
Engine  Derived 

Char.  Parameters 


00000 

11000 

12000 

13000 

14000 

15000 

22000 

24000 

26000 

29000 

41000 

42000 

44000 

45000 

46000 

49000 

51000 

54000 

56000 

57000 

61000 

62000 

63000 

64000 

65000 

67000 

71000 

72000 

73000 

74000 

75000 

76000 

91000 

96000 

97000 


4 

4 
3 

5 
3 
2 
1 
3 
0 
1 
3 
5 
5 

3 

4 
4 
2 
0 
3 
3 
2 
2 
3 
3 
2 

3 

4 
3 
3 

3 

4 
2 
2 
1 
2 


0 

1 

2 

0 

0 

0 

1 

0 

0 

1 

1 

1 

0 

1 

1 

1 

2 

2 

1 

2 

1 

1 

1 

2 

3 

2 

1 

2 

0 

0 

0 

0 

3 

1 

2 


0 

0 

0 

0 

0 

3 
2 
0 

4 
2 
0 
0 
0 
1 
1 
0 
0 
0 
1 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 


1 

1 

1 

0 

1 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


Total 

5 

6 
6 
5 

4 

5 
4 

3 

4 

5 

4 

6 

5 

5 

6 
5 

4 
2 

5 
5 
4 

3 

4 

5 
5 
5 
5 
5 
3 

3 

4 
2 

5 
2 
4 
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used  in  the  equations  of  the  fixed  wing  aircraft  model,  and  only  46  of  the  89 
parameters  of  the  Design/Performance  Data  Base  for  rotary  wing  aircraft  were 
used  in  the  equations  of  the  rotary  wing  aircraft  model. 

3.2  Reliability  Prediction  Technique.  The  two  Baseline  Reliability 
Prediction  Models  provide  an  expedient  means  of  obtaining  reliability 
predictions  for  candidate  aircraft  during  the  aircraft's  conceptual  design 
phase.  The  prediction  equations,  using  design/performance  parameters  normally 
available  during  conceptual  design,  permit  aircraft  reliability  considerations 
to  become  an  Integral  part  of  the  Initial  performance  studies. 

To  predict  the  baseline  MFHBF  of  a  notional  aircraft,  the  values  of  the 
aircraft  parameters  used  in  the  equations  of  the  appropriate  model  must  be 
obtained.  These  parametric  values  are  then  substituted  into  the  prediction 
equations  associated  with  the  two-digit  WUC  subsystems  applicable  to  the 
notional  aircraft  and  the  predicted  values  of  the  baseline  MFHBF  of  the 
two-digit  WUC  subsystems  are  calculated.  Figure  3-1  outlines  the  steps 
followed  in  predicting  the  baseline  MFHBF  of  WUC  7400H  (Weapons  Control)  for  a 
hypothetical  notional  fixed  wing  aircraft.  This  example  of  predicting  for  a 
given  two-digit  WUC  subsystem  outlines  in  further  detail  the  final  stages  of 
the  prediction  model  development/implementation  process  shown  in  Figure  2-1. 
As  the  baseline  MFHBF  prediction  equation  for  WUC  74000  is  expressed  in  terms 
of  the  natural  log  of  the  MFHBF,  In(MFHBF),  the  value  derived  in  combining  the 
terms  of  the  equation  must  be  exponentiated  to  obtain  a  value  for  the  baseline 
MFHBF. 

Having  similarly  derived  the  predicted  baseline  MFHBF  values  for  the 
remaining  two-digit  WUC  subsystems  applicable  to  the  aircraft,  the  baseline 
MFHBF  for  the  overall  weapon  system  may  be  derived.  By  summing  the 
reciprocals  of  the  predicted  baseline  MFHBF  for  the  two-digit  WUC  subsystems 
and  reciprocating  the  sum,  the  predicted  baseline  MFHBF  for  the  overall  weapon 
system  is  obtained.  This  value  may  then  be  validated  by  deriving  the  overall 
weapon  system  baseline  MFHBF  from  the  prediction  equation  for  WUC  00000. 

3.3  Model  Usage/Considerations.  Effective  use  of  the  fixed  wing  and 
rotary  wing  aircraft  prediction  models  requires  consideration  of  models' 
capabilities  and  limitations.  These  factors  are  likely  to  affect  the  manner 
in  which  the  models  are  used  and  the  results  are  interpreted. 
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Data  base  period  technology  and  historical  reliability  practices  constrain 
the  resulting  prediction  equation  estimates  to  baseline  values.  To  determine 
the  final  nol lonal  aircraft  reliability  values*  the  baseline  MFHBF  must  be 
adjusted  to  r»flect  potential  Improvements  achievable  through  technological 
advances,  the  Navy!s  "New  Look"  emphasis,  duty  cycle,  and  corrective  design 
features  to  eliminate  or  reduce  historical  failure  modes.  By  Incorporating 
estimated  improvement  factors  into  the  baseline  MFHBF  predicted  values,  the 
"then-year"  prediction  of  the  MFHBF  for  WUC  subsystems  of  fixed  wing  and 
rotary  wing  notional  aircraft  Is  obtained. 

The  objective  of  the  Baseline  Reliability  Prediction  Models  is  to  predict 
the  overall  reliability  of  fixed  wing  and  rotary  wing  notional  aircraft.  By 
predicting  the  MFHBF  at  a  two-digit  WUC  level,  the  prediction  for  the  notional 
aircraft  MFHBF  should  be  more  sensitive  to  the  overall  configuration;  and 
since  these  predicted  values  of  MFHBF  are  combined  mathematically  to  obtain 
the  predicted  baseline  MFHBF  of  the  aircraft,  the  aircraft  MFHBF  prediction 
should,  in  general,  be  more  accurate. 

The  goal  of  the  regression  analysis  performed  in  the  study  was  to  derive 
the  "best"  functional  relationship  between  the  MFHBF  and  the  aircraft 
design/performance  parameters  for  the  two-digit  WUC  subsystems  of  the  model. 
The  goal  of  the  regression  analysis  was  not  to  determine  which  aircraft 
parameters  were  the  cause  of  the  failures  at  a  two-digit  WUC  level.  The 
appearance  of  a  parameter  in  a  baseline  MFHBF  prediction  equation  cannot  be 
interpreted  as  an  indication  of  a  "cause  and  effect"  relationship.  Similarly, 
the  addition  or  subtraction  of  parameters  in  the  prediction  equation  cannot  be 
interpreted  to  mean  the  MFHBF  has  a  positive  or  negative  association  with  the 
design/performance  parameters.  A  prediction  equation  must  be  considered  in 
its  entirety. 

Differences  between  existing  and  notional  or  conceptual  aircraft  designs 
Have  affected  the  development  of  the  Baseline  Reliability  Prediction  Models 
and  might  modify  its  usage.  For  example,  the  current  3M  subsystem 
nomenclature  may  not  be  representative  of  future  aircraft  equipment  and 
functional  partitioning.  For  some  notional  design/performance  parameters  an 
equivalent  parameter  is  not  found  in  existing  aircraft;  therefore,  the 
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parameters  cannot  be  considered  in  the  model.  Other  parameters  require  a 
modified  definition  to  use  the  equations  for  prediction  of  notional  aircraft 
reliability. 

Some  design/performance  parameters  of  existing  aircraft  have  values  which 
establish  boundaries  which  may  not  be  consistent  with  those  of  notional 
aircraft.  The  values  for  notional  aircraft  parameters,  such  as  the  Maximum 
Rate  of  Climb  at  Sea  Level,  Turbine  Inlet  Temperature,  Total  Aircraft  Thrust 
and  Thrust  to  Weight  parameters,  may  lie  outside  the  range  for  existing 
aircraft  and  thus  require  extrapolation. 
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4.  CONCLUSIONS  AND  RECOMMENDATIONS 


Baseline  Reliability  Prediction  Models  presented  in  this  report  accomplish 
the  study  objectives.  A  means  is  now  available  for  evaluating  the  baseline 
reliability  characteristics  of  notional  Navy  aircraft  based  only  on  values  of 
aircraft  design/performance  parameters.  This  will  ensure  that  reliability  can 
be  given  consideration  in  conceptual  design  commensurate  with  the  increased 
emphasis  on  reliability  within  the  Navy.  In  addition,  the  models  can  be  used 
by  NAVAIR  In  establishing  weapon  system  reliability  requirements  and 
evaluating  contractor  reliability  predictions  of  proposed  aircraft. 

4.1  Conclusions.  The  models  developed  during  this  study  can  be  applied 
to  prediction  of  the  baseline  MFHBF  for  a  wide  variety  of  notional  Navy 
aircraft  and  mission  variants  for  both  fixed  and  rotary  wing  aircraft.  This 
flexibility  results  from  the  large  number  of  Navy  aircraft,  43,  used  in 
development  of  the  prediction  models. 

The  development  of  models  for  the  prediction  of  baseline  MFHBF  at  the 
two-digit  WUC  subsystem  entailed  a  comprehensive  effort.  Reliability 
characteristics  and  aircraft  design/performance  parameters  of  historical  Navy 
aircraft  were  utilized  in  prediction  equation  development.  Rigorous 
statistical  methodology  was  used  to  identify  significant  aircraft 
design/performance  parameters  for  predicting  subsystem  MFHBF.  The 
statistically  important  parameters  were  not  always  those  deemed  most  important 
by  the  design  and  systems  engineers. 

The  engine  WUC's  received  considerable  attention.  The  statistically  best 
equations  for  prediction  of  engine  MFHBF  were  contrary  to  expectations,  as 
engine  parameters  such  as  Turbine  Inlet  Temperature,  Compression  Ratio,  and 
Bypass  Ratio  were  not  found  to  be  important  predictor  variables.  This  result 
could  be  due  to  the  long  span  of  time  associated  with  progessively  improved 
technology,  as  reflected  by  increased  Turbine  Inlet  Temperature,  decreased 
Weight,  decreased  Specific  Fuel  Consumption,  while  reliability  has  remained 
essentially  constant.  Another  factor  could  be  that  the  fuel  control  within 
the  engine  subsystem  has  resulted  in  masking  the  relationship  between  engine 
reliability  and  engine  parameters. 
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The  avionics  subsystems  also  received  special  attention  during  prediction 
model  development.  One  difficulty  resulted  from  the  fact  that  avionics 
related  aircraft  parameters  generally  available  during  conceptual  design  were 
Avionics  Weight,  Installed  and  Uninstalled,  and  Environmental  Control  System 
Weight.  These  parameters  ,  were  not  sensitive  enough  to  the  two-digit  WUC 
avionics  subsystem  configurations.  Also,  rapid  technological  advances  which 
can  provide  improved  reliability  has  enabled  simultaneous  performance 
increases.  This  often  has  resulted  in  no  apparent  increase  in  reliability. 

4.2  Recommendations.  The  Baseline  Reliability  Prediction  Models 
developed  during  this  study  and  presented  in  Tables  2-1  and  2-5  in  Volume  2 
are  complete  and  are  in  a  usable  form.  However,  ways  of  increasing  usage 
flexibility  and  enhancing  the  models  have  been  identified  during  the  study. 
These  are  reflected  in  the  following  recommendations: 
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Remove  the  failures  reported  against  the  fuel  system  from  the  engine 
WUCs  to  more  accurately  reflect  engine  associated  failures,  and  then 
derive  new  baseline  MFH8F  prediction  equations  for  the  engine  by 
again  considering  engine  related  parameters  such  as  Turbine  Inlet 
V  Temperature,  Compression  Ratio,  andjjjumber  of  Engine  Parts. J 
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Identify  design/performance  parameters  available  during  conceptual 


/^design  which  are  more  responsive  to  avionjc  subsystems  configuration 
!  and  refine  the  baseline  MFHBF  prediction  equations  for  two-digit  WUC 
avionic.. 'subsystems. 
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3.  Assess  trends  in  reliability  due  to  changing  technology  of  engines, 

\  V  * 

avionics,  and  structures.  Mathematically  relate  MFHBF  to  technology 
\  sensitive  design/performance  parameters  so  that  then-year  reliability 
parameters  of  notional  Navy  aircraft  may  be  evaluted  in  addition  to 
baseline  reliability  parameters. 


/> 


4.  Refine  the  models  to  reflect  the  contribution  of  each  aircraft,  used 
in  development  of  a  prediction  equation,  according  to  the  total 
number  of  flight  hours  for  the  aircraft.  That  is,  permit  those 
aircraft  with  more  flight  hours  to  carry  more  weight  in  the  analysis 
of  the  data  than  those  aircraft  with  fewer  flight  hours. 
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